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LINEAR  FILTER  OPTIMIZATION 
WITH  GAME  THEORY  CONSIDERATIONS' 
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M,  C.  Yovits  and  J.  L.  Jackson 
Applied  Physics  Laboratory 
The  Johns  Hopkins  University 
Silver  Spring,  Md. 


Summary 


The  optimum  reproduction  of  a  signal  in  the  presence  of  noise  by 
means  of  linear  filters  is  considered  when  the  signal  is  unknown.  The  prob¬ 
lem  is  likened  to  a  game.  In  such  a  game  the  signal  spectrum  can  be  con¬ 
sidered  to  be  the  strategy  of  one  of  the  participants,  while  the  strategy 
of  the  other  participant  is  specified  by  the  transfer  function  of  the  fil¬ 
ter.  The  payoff  is  taken  to  be  the  mean  square  difference  between  filter 
output  and  signal.  The  signal  producer  by  his  choice  of  spectrum  attempts 
to  maximize  the  difference  while  the  filter  designer  attempts  to  minimize 
it. 


In  order  to  obtain  game  theory  solutions  the  optimum  transfer 
function  for  any  fixed  signal  spectrum  and  also  the  optimum  signal  spectrum 
for  any  allowable  transfer  function  are  found.  The  game  theory  solution  is 
then  the  intersection  of  these  two  functional  equations. 

In  order  to  obtain  the  optimum  transfer  function  for  any  fixed 
signal  spectrum  in  a  convenient  form  a  new  variational  procedure  has  been 
developed  which  yields  an  integral  equation  for  the  amplitude  of  the  trans¬ 
fer  function.  The  form  of  the  relationship  is  dependent  only,  on  the  noise 
spectrum.  For  simple  noise  spectra  the  results  are  both  simple  and  con¬ 
venient  for  game  theory  solutions. 

The  new  variational  procedure  enables  one  easily  to  find  the  op¬ 
timum  transfer  function  when  various  of  the  mean  square  time  derivatives  of 
the  filter  output  are  fixed.  This  is  shown  to  be  formally  equivalent  to 
finding  the  optimum  transfer  function  for  polynomial  noise  spectra.  De¬ 
tailed  calculations  of  the  game  theory  solution  for  the  case  where  the  mean 
square  second  time  derivatives  of  both  the  filter  output  and  the  signal  are 
fixed,  have  been  performed.  The  mean  square  difference  has  been  computed  as 
a  function  of  the  ratio  of  the  output  to  signal  second  derivatives.  This  is 
presented  graphically. 


*  Thia  work  vat  supported  by  the  Bureau  of  Ordnance,  Department  of  the  Navy, 
Under  Contract  N0rd^7386. 

t Presented  at  the  X.R.E.  National  Convention,  New  York  City,  March  21-24,  1955. 
Now  contained  in  the  1955  National  I.R.J.  Convention  Record,  Part  4,  Computers, 
Information  Theory,  Automatic  Control,  page  193, 

$  Now  on  leave  of  absence  with  the  Office  of  Naval  Research,  Washington,  D.  C. 
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Introduction 


The  problem  which  is  considered  in  this  paper  is  that  of  follow¬ 
ing  a  signal  in  the  presence  of  noise  as  closely  as  possible  with  a  linear 
filter.  The  filter  input,  which  is  a  function  of  time,  is  in  general  made 

up  of  both  signal,  x  (t),  and  noise,  x  (t).  It  is  desired  to  choose  a 

s  n 

linear  filter,  the  output  of  which,  xQ(t),  matches  the  input  signal*  Due 

to  the  presence  of  the  noise  in  the  input  it  is  clearly  impossible  for  x  (t) 

to  be  identical  to  x8(t).  The  object,  then,  is  to  choose  that  linear  filter 

which  matches  the  two  as  closely  as  possible.  A  convenient  criterion  for  an 
optimum  filter  is  the  one  which  minimizes  the  mean  square  difference  between 
the  filter  output  and  the  input  signal* 

Schematically  the  system  is  depicted  in  Fig.  1* 


X  (t)  +  X  (t) 

s  n 

S 

Linear  Filter 

*o(t) 

S 

F(o>) 

The  Basic  System 
Fig.  1 


The  filter  is  considered  to  be  a  box  whose  characteristics  are  to  be  chosen 

in  order  to  minimize  the  mean  square  difference  between  x  (t)  and  x  (t). 

0  8 

The  input  signal  and  noise  are  taken  to  be  stationary  random  func¬ 
tions  j  that  is,  the  probability  distributions  which  describe  the  time  func¬ 
tions  are  invariant  with  respect  to  a  change  of  the  time  zero,,  Further,  the 
signal  and  noise  are  taken  to  be  uncorrelated. 
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For  such  a  system,  the  mean  square  difference  between  the  filtor 
outrmt  and  the  input  signal,  the  error,  is  given  by 


2  2 

J  £s(<o)  |  1  -  F(a>)  |  +  N (co)  |  F(co)|  J  dco  ,  (l) 

-  00 


where  S(a>)  is  the  spectral  density  of  the  signal  and  N (co)  is  the  spectral 
density  of  the  noise.  It  is  seen  that  the  miss  is  made  up  of  two  parts. 

The  first  part,  /^S(co)  |l  -  F(co)|  ^  dco,  is  the  miss  which -is  obtained  be- 


i® 


cause  the  transfer  function  differs  from  unity  and  consequently  does  not 
follow  the  signal  exactly.  Hie  second  part,  I  N (co)  |F(  co)|  ^  dco,  is  the 
miss  which  is  obtained  because  the  system  does  follow  the  noise. 


Eq.  (l)  is  a  standard  equation,  the  derivation  of  which  is  im¬ 
mediate  when  the  signal,  noise,  and  output  are  transformed  to  their  Fourier 
components.  Hie  mean  square  error  is  then  found  by  squaring  the  absolute 
difference  between  the  output  and  the  signal  and  integrating  over  all  fre¬ 
quencies.  The  (2n)  is  a  normalization  factor  which  appears  because  of  the 
way  in  which  the  power  spectrum  is  defined. 

It  is  desired  to  minimize  the  error  of  Eq.  (l)  by  the  proper 
choice  of  a  realizable  transfer  function,  the  so-called  optimum  transfer, 
function.  In  previous  work  in  this  field  as  developed  by  Wiener  et  al,  1 
it  is  necessary  in  order  to  find  the  optimum  transfer  function  that  both 
the  signal  and  noise  spectral  densities  be  known. 


This  paper  however  is  concerned  with  the  problem  of  finding  the 
optimum  filter  over  a  class  of  possible  signal  spectral  densities.  Specif¬ 
ically,  the  situation  is  considered  where  the  producer  of  the  signal  by  his 
choice  of  spectrum  attempts  to  maximize  the  error.  Whatever  is  producing 
the  signal  prefers  not  to  be  followed  by  the  filter.  Hie  signal  spectral 
density  is  thus  no  longer  to  be  regarded  as  a  fixed  function,  given  for  the 
problem,  but  rather  as  the  strategy  of  one  of  the  participants  of  a  game. 

Hie  strategy  of  the  other  participant,  the  designer  of  the  filter,  is  spec¬ 
ified  by  the  transfer  function  of  the  filter.  The  payoff  of  the  game  is 
taken  to  be  the  mean  square  difference  between  output  and  input  signal. 

Hie  problem  of  the  filter  designer  thus  becomes  one  of  designing  the  best 
filter  in  view  of  what,  from  his  viewpoint,  is  the  worst  choice  of  the  sig¬ 
nal  spectral  density  by  the  signal  producer..  From  the  viewpoint  of  the 
signal  producer,  a  signal  is  generated  which  has  statistical  properties  that 
will  result  in  the  greatest  possible  miss  despite  the  best  possible  efforts 
of  the  filter  designer.  If  these  two  considerations  are  mutually  compat¬ 
ible,  then  there  is  said  to  be  a  game  theory  solution  end  the  functions 
which  satisfy  these  requirements  are  that  solution. 
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In  order  to  obtain  game  theory  solutions  the  optimum  transfer 
function  for  any  fixed  signal  spectrum  and  also  the  optimum  signal  spec¬ 
trum  for  any  allowable  transfer  function  are  found.  Ihe  game  theory  solu¬ 
tion  is  then  the  intersection  of  these  two  functional  equations* 

To  obtain  the  optimum  transfer  function  for  any  fixed  spectrum 
in  a  form  convenient  for  game  theory  analysis  a  new  variational  procedure 
has  been  developed  which  yields  an  integral  equation  for  the  amplitude  of 
the  transfer  function.  For  simple  types  of  noise  spectra  the  resulting  in¬ 
tegral  equation  is  easily  solved.  The  functional  form  of  the  solution  is 
dependent  only  on  the  func  tional  form  of  the  noise  spectrum.  Ihe  resulting 
solutions  have  a  form  which  make  them  especially  susceptible  to  game  theory 
analysis* 


Ihe  method  utilized  is  basically  8  simple  one  involving  only  ele¬ 
mentary  mathematics.  In  the  hope  that  it  will  provide  additional  insight 
into  the  general  optimum  filter  problem  it  is  sketched  here,  It  should  be 
noted  that  this  method  provides  a  rigorous  and  straightforward  way  of  ob¬ 
taining  the  optimum  transfer  function  for  the  cases  where  the  noise  spectral 
density  increases  at  large  frequencies  with  increasing  frequency.  Such  a 
situation  is  of  more  than  academic  importance,  as  will  be  shown  later. 


The  Optimum  Transfer  Function 


It  is  desired  to  minimize  the  mean  square  error  of  Eq.  (l)  by  the 
proper  choice  of  realizable  transfer  function.  If  is  to  be  a  minimum  it 
must  be  stationary  with  respect  to  any  small  realizable  variation  in  the 
transfer  function,  F(co).  For  game  theory  analysis  it  is  found  to  be  neces¬ 
sary  to  apply  the  variation  to  1  -  F(o>)  rather  than  to  F(co)  itself.  For 
convenience  1  -  F(<a)  is  called  G(co).  The  phase  which  accompanies  G(a>)  is 
said  to  be  0(co).  Ihe  vectors  F(co)  and  G(co)  can  be  considered  to  be  two 
sides  of  a  triangle,  the  third  side  of  which  is  unity.  They  are  thus  re¬ 
lated  to  each  other  by  the  law  of  cosines.  Consequently  Eq.  (l)  becomes 

CO 

*  -  */■{[•«  *  N(a>)]  *  |G(co)|  2  +  N(o>)  -  2N(co)  |g(co)|  cos  0(co)|  dco« 

(la) 


A  general  variation  in  the  log  of  |g(  os)  I  which  can  conveniently 
be  used  is  indicated  in  Tig.  2.  Ihe  variation  of  height  h  and  width  £  is 
applied  at  an  arbitrary  frequency  co^* 
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General  Variation  in  Log  |  1  -  F (co)  I 
Fig.  2 


Since  the  variation  must  be  a  realizable  one,  the  change  in  phase  associated 
with  it  is  given  from  the  usual  criterion  for  realizability.  ^  Algebraically, 


60  ■ 


.2h£ 

n  2 


co 


(2) 


03  -  CO. 


If  one  sets  the  first  variation  of  equal  to  zero,  the  following 
integral  equation  results: 

00 

|  IgI  2  (S  +  N)  -  N  |g|  COS  p}  -  |  do3 


CO  *  03, 


o  03  -  03. 


CD 


1  C  03_  N_ 

ni  J  2  ~ 


dco  , 


(3) 


-CO 


03-0), 
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where  it  is  now  understood  that  G,  S,  and  N  are  all  functions  of  co.  Hie 
right  side  of  Eq.  (3)  for  an  analytically  given  noise  spectrum  is  readily 
evaluated  by  integration  in  the  complex  co-plane  around  the  contour  shown 
in  Fig*  3*  The  radius  of  the  semi-circle  is  very  large.  Since  G(co)  has 
no  singularities  in  the  lower  half  plane,  the  integral  can  be  evaluated 
in  terms  of  the  poles  of  N(«o)  in  this  region. 


Fig.  3 


Simplification  results  when  it  is  noted  that  the  contribution  from  the 
poles  +  coA  is  identically  N  |G|  cos  Pj  •  Hius  an  expression  results 

\ 

which  gives  |g|^  (S  +  N)  in  terms  of  the  values  of  G  at  the  poles  of  N. 

For  the  case  where  N  ■  N  ,  a  constant  (white  noise),  it  is  seen 

0  ' 

that  the  solution  for  the  optimum  transfer  function  is 

2  .  .2 


N(co)  -  N 


|o(co)|  »  I  1  -  F(co)|  -  . 


<U) 
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For  Markoffian  noise,  N(aj) 
readily  Riven  as 


N 

o 


the  optimum  transfer  function  is 


N  a 

N(<o)  -  -y »2  ) 
w  +  a 


|0U)|2.  |i-F(ffl)|2.Kt  ,  (5) 


where 


K 


»  e*p  f  N(a)  106  ststHtst  d"J  • 


(5a) 


More  complicated  types  of  noise  spectra  give  similar  albeit,  more 
complicated,  results.  Should  it  be  desired  to  obtain  the  actual  transfer 
function,  F(w) ,  this  can  be  done  from  the  law  of  cosines  where  the  phase  is 
ottained  uniquely  from  the  realizability  criterion.  *t  can  be  shown  that 
for  simple  noise  spectra  like  those  above,  G(o>)  must  be  minimum  phase. 

ftie  above  results  are  of  course  in  agreement,  although  in  differ¬ 
ent  forms,  with  the  results  as  given  by  Wiener.-^- 

One  can  integrate  each  term  of  Eq.  (3)  with  respect  tp  from 

-  <0 to  ♦  CD.  If  N(co)  goes  to  zero  at  infinity,  the  order  of  integration  of 
the  double  integral  on  the  right  hand  side  of  the  equation  can  be  inter¬ 
changed  and  is  then  seen  to  be  identically  zero.  The  relation  is  obtained 

then  for  the  optimum  iGh  ,  where  is  now  called  <p 

00  CD 

nU)  ->  0  i  I  |G|2pt(S  +  N)  dco  »  f N  ^opt  cos  ^  d“  •  (6) 

£0  ->  00  O  o 

This  leads  to  the  relationship  for  the-  optimum  error 

co  r  - 

■  *  /  L"  '  101  ^  (S  *  10  J  d“  * 


N(oj)  — >  0  j 

£0— >00 


(6a) 
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As  will  be  shown  later,  cases  where  the  noise  soectrel  denBity 
increases  at  infinite  frequency  are  of  importance.  For  such  cases,  the  in¬ 
tegral  of  Eq.  (3)  does  not  converge".  It  is  necessary  to  use  a  less  general 
variation  than  that  shown  in  Fig.  2;  i.e.,  a  dipole,  qu&drapole,  or  higher 
order  variation  depending  on  the  behavior  of  the  noise  srectrum  at  infinity. 
A  slightly  different  variational  equation  for  the  optimum  transfer  function 
results. 

For  example,  when  the  noise  spectrum  is  a  polynomial  of  order  co1 
then  the  variational  equation  to  be  solved  is 


N(co)  ■  co2  ♦  oi*  f 


This  is  readily  solved  to  give  for  the  optimum  transfer  function 


N(co)  -  N  * 


Ngco2  ♦ 


V 


|l  -  F(«o)| 


2 


N  («)  +  K 


(8) 


where  K  is  given  by 


CO 

f  lpg 

o 


N(oo)  +  K 
N(co)  +  5(co) 


da> 


0  . 


(8a) 


Similar  results  are  obtained  for  polynomial  noise  spectra  of  other 

orders. 

It  is  important  to  note  that  the  functional  form  of  the  relation¬ 
ship  for  the  optimum  |g(co)|  2  is  dependent  only  on  the  functional  form  of  the 
noise  spectrum. 


For  noise  which  does  not  decrease  at  infinity,  Eqs.  (6)  and  (6a) 
are  no  longer  valid.  It  can  be  shown  that  Iq.  (6a)  then  become* 

N  (co)  is  a  polynomials 


°2oPt  *  -  i  /  [N  - 1  °iSpt  (s  ♦  N)  +  N  io*  i°ioPt]  d“  •  «*> 

Note  for  tht  case  of  white  noise, 


Optimum  Signal  Spectrum  and  Game  iheory  Solutions 


That  transfer  function  which  minimizes  the  mean  square  error  for 
any  given  stationary  input  signal  has  now  been  found.  This  transfer  func¬ 
tion  can  be  considered  to  be  the  strategy  of  one  of  the  participants  of  a 
game.  The  strategy  of  the  other  participant  can  be  considered  t<j  be  the  in¬ 
put  signal  spectrum.  Ibis  participant  attempts  to  maximize  the  error  for 
any  given  transfer  function. 

Clearly  the  input  spectral  density  which  maximizes  the  mean  square 
error  is  dependent  on  the  restrictions  imposed  on  this  spectrum.  If  there 
are  no  restrictions  placed  on  the  input  then  evidently  the  error  is  a  maxi¬ 
mum  when  the  spectrum  is  everywhere  infinite. 

If  the  mean  square  value  of  the  time  derivative  of  the  signal 
is  fixed  to  be  some  constant, M,  then  it  can  be  shown  that  S  (co)  must  have  the 
form 


S  (co) 


g(o>) 


(9) 


where  g(co)  is  the  signal  choice  function  defined  o'o  that 
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The  signal  producer  desires  to  choose  pta)  in  such  a  way  as  to 
maximize  the  mean  square  error  for  any  given  transfer  function.  It  is  clear 
upon  examination  of  Eq,  (l)  that  this  is  accomplished  if  the  signal  spectrum 

has  a  value  only  at  the  maximum  values  of  | G (co)|  2/co2n  and  is  elsewhere  zero. 
The  intersection  between  this  functional  relationship  and  the  applicable  re¬ 
lationship  for  the  optimum  |g(  co  )|2  for  any  input  signal  spectrum  is  said  to 
be  the  game  theory  solution. 

For  the  simpler  noise  spectral  densities  which  have  already  been 
considered  it  is  easily  shown  that  the  solution  exists  and  is  unique.  It  is 
easily  shown  that  the  only  conditions  under  which  a  solution  exists  is  for 

|G(  co)|  2/co2n  to  have  a  broad  maximum  which  extends  from  to  •  0  to  some  coq,  the 

cutoff  frequency.  The  input  spectrum  S(co)  must  be  continuous  at  the  cutoff 
frequency  coq  and  indeed  must  be  equal  to  zero  at  this  point.  Otherwise  the 

hypothesis  that  |g (co)|  2/co2n  is  a  maximum  in  the  frequency  region  below  co 
would  be  contradicted.  0 

Ihe  solution  is  here  carried  through  for  the  case  of  white  noise, 
N(co)  ■  Nq.  As  has  been  indicated,  the  optimum  transfer  function  for  this 

case  is  given  by 


■  N  °  S(to)  •  (l0) 

o  • 


The  quantity  |g|  2/co2n  is  a  constant  in  the  frequency  region  between  zero  and 
coq.  Since  S(co),  by  hypothesis,  is  zero  outside  this  region,  lG(co)|2  j_8  unity 

for  frequencies  greater  than  coq.  Continuity  at  coq  then  dictates  that  the 

game  theory  transfer  function  be  given  by 


|  G(co)| 


2 


( 


(u/(0o)2n 

1 


9 


9 


CO  <  , 

*  >  “o  * 


(10a) 


Uie  cutoff  frequency  is  determined  from  the  condition  that 


00 

J  g(w) 

CD 


dco 


1  . 


(10b) 
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Substitution  of  Eq,  (lOa)  into  Eq.  (10 )  gives  for  the  game  theory  signal 
spectrum,  S(co) 


10  a)  >  co 


The  relationship  between  S(co)  and  g(co)  substituted  into  Eq.  (lOb)  yields  the 
cutoff  frequency,  coq.  Thus 


2n  ♦  1  2n  +  1 

CO  ■  - r - 

o  2n 


(lOd) 


2 

The  quantity  (M  /hQ)  is  a  dimensional  parameter  which  determines  the  error. 

It  is  to  be  noted  that  G(co)  is  the  well  known  so-called  semi-in- 
finite  slope.  The  phase  for  such  a  transfer  function  is  given  by  Bode,  2 
Chap.  XV.  A  knowledge  of  the  phase  enables  one  easily  to  obtain  F(co),  the 
actual  transfer  function,  from  the  law  of  cosines. 

For  other  noise  spectra  the  solutions  are  obtained  similarly,  al¬ 
though  not  as  conveniently.  The  results  are  generally  not  as  simple  as 
those  for  white  noise. 

When  the  optimum  transfer  function  is  used,  all  of  the  mean  square 
time  derivatives  of  the  output  become  infinite.  The  argument  follows.  It 

is  to  be  noted  from  Eq.  (l)  that  N(co)  If (o>)|  ^  and  S (oo)l G (co)|  ^  enter  the  expres¬ 
sion  for  the  mean  square  miss  symmetrically.  Thus  an  integral  equation  in 
terms  of  F(co)  similar  to  Eq.  (3)  can  be  derived  by  replacing  G(co)  by  F(co)  and 
interchanging  S(co)  and  N(co).  Examination  of  this  equation  indicates  that  for 
the  optimum  transfer  function 


constant 

2 

co 


CO 


CD 


(11) 
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In  terms  of  its  power  spectrum  the  mean  square  value  of  the 
time  derivative  of  a  stationary  random  function  is  known  to  be  given  by 

—  /  a?n  S  (a)  dco  •  Ihus  the  mean  square  value  of  the  n^  time  derivative  ’ 
of  the  filter  output  is 


When  the  optimum  transfer  function  is  used  it  is  seen  that  because  of  the 
noise  contribution  all  the  mean  square  derivatives  are  infinite. 


?  th 

The  minimization  of  <r  subject  to  the  restriction  that  its  n-^ 

mean  square  time  derivative  be  finite  can  be  accomplished  by  the  method  o 

2 

Lagrange  multipliers.  It  is  then  desired  to  minimize  a  *  X 


(\£A 

V  dtn 


Here  X  is  a  Lagrange  multiplier,  the  value  of  which  determines  the  value  of 
the  derivative.  Ihis  process  is  especially  simple  if  only  the  contribution 
due  tp  noise  (the  portion  which  causes  the  divergence)  is  limited.  It  is 
necessary  then  to  minimize 


+  X 


X  u2^)  |  FU)|  2  } 


da) 


(13) 


For  the  case  of  greatest  interest,  white  noise,  it  is  noted  that  the  problem 

is  formally  equivalent  to  minimizing  a  fictitious  with  a  given  input  sig¬ 
nal  and  a  polynomial  noise  spectrum. 


Ihe  game  theory  error  has  been  computed  for  the  case  where  the  mean 
square  second  derivative  of  both  the  input  signal  and  the  output  are  limited, 
lhe  game  theory  error,  normalized,  has  been  plotted  in  Fig.  U  as  a  function 
of  the  ratio  of  the  root  mean  square  second  derivative  of  the  output  due  to 
noise  to  the  root  mean  square  second  derivative  of  the  input  signal. 


NORMALIZED  GAME  THEORY  ERROR 


-1> 


MEAN  SQUARE  GAME  THEORY  ERROR 
AS  A  FUNCTION  OF  THE  RATIO  OF  THE 
RMS  OUTPUT  2  —  DERIVATIVE  DUE  TO 
NOISE  (DENOTED  AS  M«)  TO  THE  RMS 
SIGNAL  2 —  DERIVATIVE 


RMS  OUTPUT  20 4  DERIVATIVE  DUE  TO  NOISE 
RMS  SIGNAL  2^  DERIVATIVE 
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